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[57] ABSTRACT 

A vehicle detection system for providing data charac- 
teristic of traffic conditions includes a camera overlook- 
ing a roadway section for providing video signals repre- 
sentative of the field (traffic scene), and a digitizer for 
digitizing these signals and providing successive arrays 
of pixels (picture elements) characteristic of the field at 
successive points in space and time. A video monitor 
coupled to the camera provides a visual image of the 
field of view. Through use of a terminal and in conjunc- 
tion with the monitor, an operator controls a formatter 
so as to select a subarray of pixels corresponding to 
specific sections in the field of view. A microprocessor 
then processes the intensity values representative of the 
selected portion of the field of view in accordance with 
spatial and/or temporal processing methods to generate 
data characteristic of the presence and passage of vehi- 
cles. This data can be utilized for real-time traffic sur- 
veillance and control, or stored in memory for subse- 
quent processing and evaluation of traffic flow condi- 
tions. 

33 Claims, 5 Drawing Sheets 
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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to traffic de- 
tection and monitoring equipment. In particular, the 
present invention is a vehicle detection system in which 10 
infrared or visible images of highway/street scenes are 
processed by digital computing means to determine 
vehicle presence, passage, measure various traffic pa- 
rameters and facilitate traffic surveillance and control. 
The system also can be used as a vehicle counter/clas- 15 
sifter, and other traffic engineering applications such as 
incident detection, safety analysis, measurement of traf- 
fic parameters, etc. 

2. Description of the Prior Art 

Traffic signals are extensively used to regulate the 20 
flow of traffic at both high volume urban intersections, 
and rural or suburban low volume intersections where 
safety rather than capacity and efficiency is the major 
concern. The timing of traffic control signals (i.e., the 
cycle time and amount of green provided to each move- 25 
ment) is either fixed through the use of historical data, 
or variable and based upon real-time sensed data. Tim- 
ing sequences of pretimed traffic control signals are 
derived from historical information concerning the 
demand patterns, while real-time traffic control deci- 30 
sions are derived from actual traffic flow information. 
This information can be processed locally, or remotely- 
transmitted to a central computer where decisions 
about signal settings are made. Real-time traffic control 
signals have the ability to respond to rapid demand 35 
fluctuations and are in principle more desirable and 
efficient than pretimed signals. 

Currently used equipment for real-time control of 
traffic signals is expensive and often inaccurate. Effec- 
tive traffic sensing for surveillance and control of free- 40 
ways and arterial streets requires vehicle detection, 
counting, classifying and other traffic parameter mea- 
surements. The overwhelming majority of such detec- 
tors are of the inductive loop type, which consist of 
wire loops placed in the pavement to sense the presence 45 
of vehicles through magnetic induction. Since lie infor- 
mation extracted from such detectors is very limited, 
installation of a number of such detectors is often re- 
quired to obtain requisite data for sophisticated traffic 
control and surveillance systems. For example, mea- 50 
surements of traffic volume by lane require at least one 
detector per lane, while measurement of speed requires 
at least two detectors. A problem with existing systems 
is reliability and maintenance. In major cities 25%-30% 
of inductive loops are not operational. In addition, in- 55 
ductive loops are expensive to install. 

Electro-optical vehicle detection systems which uti- 
lize visible or infrared sensors have been suggested as a 
replacement for wire loop detectors. The sensor of such 
systems, such as an electronic camera, is focused upon a 60 
field of traffic and generates images at predetermined 
frame rates (such as standard television). Under com- 
puter control, frame data with traffic images is cap- 
tured, digitized, and stored in computer memory. The 
computer then processes the stored data. Vehicle detec- 65 
tion can be accomplished by comparing the image of 
each selected window with a background image of the 
window in the absence of vehicles. If the intensity of the 
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instantaneous image is greater than that of the back- 
ground, vehicle detection is made. After detection, the 
vehicle's velocity and signature can be extracted. From 
this, traffic data can be extracted and used for traffic 
control and surveillance. 

. In order for electro-optical vehicle detection systems 
of this type to be cost effective, a single camera must be 
positioned in such a manner that it covers a large field of 
traffic so that all necessary information can be derived 
from the captured image. In other words, one camera 
must be capable of providing images of all strategic 
points of an intersection approach or of a roadway 
section from which it is desired to extract information. 
The time required by the computer to process frames of 
these images is very critical to real-time applications. 
Furthermore, currently used methods for processing 
the data representative of the images are not very effec- 
tive. 

It is evident that there is a continuing need for im- 
proved traffic control and surveillance systems. To be 
commercially viable, the system must be reliable, cost- 
effective, accurate and perform multiple functions. 
There is a growing need for controlling traffic at con- 
gested street networks and freeways. This can only be 
accomplished through real time detection and surveil- 
lance devices. Such a machine-vision device is proposed 
here. The ultimate objective is to replace human ob- 
servers with machine-only vision for traffic surveillance 
and control. Finally, the proposed device increases 
reliability and reduces maintenance since it does not 
require placement of wires to the pavement. 

SUMMARY OF THE INVENTION 

A vehicle detection system in accordance with one 
embodiment of the present invention includes sensor 
means for sensing the field of traffic and for providing 
successive arrays of pixels characteristic of the field. 
Formatter means coupled to the sensor means select a 
subarray of pixels characteristic of a portion of the field 
of traffic. Processor means process the selected subar- 
ray of pixels and provide data representative of vehicle 
presence and/or passage within the portion of the field 
represented by the subarray. 

In one embodiment, the processor means spatially 
processes the pixel arrays to generate data characteristic 
of vehicle presence and/or passage. In another embodi- 
ment, the processor means temporally processes the 
pixel arrays to generate data characteristic of the vehi- 
cle presence and/or passage within the field. In still 
another embodiment, the processor means logically 
combines the spatially processed data and temporally 
processed data to generate data characteristic of vehicle 
presence and/or passage within the field. 

The vehicle detection system of the present invention 
is both effective and cost efficient. Use of the formatter 
permits specific sections or portions of images produced 
by the camera to be selected and processed. A single 
camera can therefore be effectively used for multiple 
detection, i.e. detection of many points along the road- 
way. Portions of the image which are not required to be 
processed are not used, thereby saving computer time. 
Furthermore, the temporal and spatial data processing 
methods can quickly process data and produce accurate 
results. Accurate real-time traffic control can thereby 
be implemented. 
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^ *ttt, a ,„tx^n intensity, I, of image 30 at discrete locations in the ith 

BRIEF DESCRIPTION OF THE DRAWINGS rowjth column of nth frame as illustrated in FIG. 2. 

FIG. 1 is a block diagram representation of a vehicle As shown, digitizer 14 breaks image 30 into an i by j 

detection and traffic control system in accordance with frame or array of pixels. Although I=J= twenty-two in 

the present invention. S the example illustrated in FIG. 2, larger arrays will 

FIG. 2 is a graphic representation of a digitized frame typically be used, 

of an image captured by the camera shown in FIG. 1. Depending upon the position and orientation of cam- 

FIG. 3 is a graphic representation illustrating the era 12 with respect to roadway 26 (FIG. 1), image 30 

operation of the formatter shown in FIG. 1. can be of a rather large field of traffic However, to 

FIG. 4 is a block diagram representation of a spatial 10 extract various types of information from image 30, 

data processing method which can be performed by the (e.g., queue length in the leftmost lane, presence of 

system shown in FIG. 1. vehicles in an intersection, or velocity of vehicles in the 

FIG. 5 is a graphic representation of the spatial aver- right lane), it is typically necessary to process only 

aging step performed by the spatial data processing certain portions of image 30. 

method illustrated in FIG. 4, 15 As illustrated in FIG. 1, monitor 13 is connected to 

FIG. 6 is a block diagram representation of a tem- receive the video signals from camera 12, and can 

poral data processing method which can be performed thereby provide a real-time display of image 30. FIG. 7 

by the system shown in FIG. 1. is a graphic representation of an image 30, correspond- 

FIG. 7 is a graphic representation of an image dis- ing to that of FIGS. 2 and 3, being displayed on monitor 

played by the monitor of FIG. 1 and illustrating the 20 13. Using terminal 20, an operator can select a desired 

operation of the terminal and formatter. portion or window of image 30 for further processing. 

FIG. 8 is a graphic representation of the logic pro- In one embodiment, the operator uses terminal 20 to 

cessing step illustrated in FIG. 8. position an indicator such as curser 15 (FIG. 7) at loca- 

FIG. 9 is a block diagram representation of another tions on monitor 13 which define the desired window, 

processing method which can be implemented by the 25 Through terminal 20, the operator can cause formatter 

system shown in FIG. 1. 16 to select from digitizer 14 the pixels I,/ 1 which repre- 

FIG. 10 is a graphic representation illustrating a ve- sent the portion of image 30 within the window. The 

locity determination processing method. selected pixels lif are then transferred to microproces- 

FIG. 11 describes equations 1-15 which are imple- sor 18 and stored in RAM 17. 

mented by the system shown in FIG. 1. 30 The above procedure can be described in greater 

DFTATT FD DP SPTl TPTTniST OF THF detail ^ reference to 3 and 7 - If > f ° r example, 

^f^dImb^me™ il'^^js^ z do o™^ 

upper portion of the leftmost lane, the operator can 

A vehicle detection and traffic control system 10 in position curser IS at locations representing the upper 

accordance with the present invention is illustrated 35 left and lower right comers of this window. In re- 

generally in FIG. 1. As shown, vehicle detection system sponse, formatter 16 will select pixels I,/ 1 for 4^i^ 10 

10 includes a sensor such as camera 12, monitor 13, and 5^j^8 which represent the portion of image 30 

digitizer 14, formatter 16, computer means such as mi- within window 40. The pixels will then be transferred 

croprocessor 18, associated random access memory or through microprocessor 18 to RAM 17. This procedure 
RAM 17 and read only memory or ROM 19, terminal 40 is repeated for successive frames 29. In a similar manner 

20, traffic signal control 22, and recorder 24. Camera 12 pixels lif for i= 19 9^j ^ 13 representing window 41, or 

can be positioned at a height of twenty-five to forty feet If for 8^i^ 14 j = 12 representing window 43, can be 

on a streetlight pole, stoplight pole, building or other selected. 

support structure (not shown) and is focused upon a Once selected and stored, pixels lif representative of 

desired field of traffic on a roadway 26 such as that 45 successive frames of the windowed portion of image 30 

shown in FIG. 1. Camera 12 can be any of a wide vari- can be processed by microprocessor 18 in accordance 

ety of commercially available devices which sense visi- with various temporal, spatial and/or other statistical 

ble energy reflected by vehicles 28 traveling along methods to determine the presence, passage, velocity, 

roadway 26 within the camera's field of view. Camera or other characteristics of the vehicles 28 within the 

12 can operate in a conventional manner using standard 50 selected window of roadway 26. This data can then be 

television frame rates. utilized by traffic signal control 22 in known manners to 

As illustrated in FIG. 2, each successive frame 29 optimize the flow of traffic along roadway 26 in re- 

(only one is shown) captures an image 30 of the field of sponse to currently existing traffic conditions. Alterna- 

traffic at an instant in time. Camera 12 provides analog tively, the data can be recorded by recorder 24 for 

video signals characterizing image 30 as a sequence of 55 subsequent processing and/or evaluation, 

scan lines 32. Each scan line lasts for approximately 65 A spatial data processing method implemented by 

microseconds for a frame comprised of 484 scan lines microprocessor 18 to determine the presence, passage 

and represents the intensity of energy reflected from a and/or other characteristics of vehicles 28 is described 

zone of the scene covered by the field of view of the with reference to FIG. 4. The spatial data processing 

camera. Although camera 12 has been described as one 60 steps illustrated in FIG. 4 enable system 10 to make a 

operating in the visible portion of the spectrum, other determination of the characteristics of vehicles 28 from 

types of sensors including infrared (IR) sensors which a single "look" at the field of traffic at one instant of 

sense infrared energy radiated from a scene can be used time. This determination is based upon a comparison of 

wel1 - measures extracted from an instantaneous image with 

Analog video signals produced by camera 12 are 65 corresponding measures which are characteristic of 

digitized by digitizer 14. Digitizer 14 includes a digital- background data in the image. The determination of 

to-analog converter which converts the analog signals vehicle presence and/or passage is therefore based upon 

of the scan lines into pixels If representative of the characteristics of an intensity profile of the selected 
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window of image 30 represented by its pixels I*/ 1 . The The variance a V// 1 in the absence of a vehicle is esti- 

underlying assumption for the processing approach is mated using Equation 9 with feedback from logic 58. If 

that the signature of instantaneous intensity profile of logic 58 decided that there is a vehicle in the window of 

the selected portion of image 30 is significantly altered interest the nth frame a V// 1 is not updated, that is a V// 1 ' 

when a vehicle 28 is present in the field of view. 5 =* A Vf- l . If logic decided that there is no vehicle pres- 

Pixels If for the nth frame (latest) of a window such ent in the window then A^f is updated per Equation 9. 
as 43 are first time averaged by microprocessor 18 with Logic 58 operates either on the background adjusted 
corresponding pixels of the previous N frames as indi- intensity If or on the variance Vf. If If M(a Vf) or 
cated at step 50. N is a parameter stored in RAM 17 or Vf>kAVf where l^k^4 then, potentially, there is a 
ROM 19. In one embodiment, microprocessor 18 pro- 10 vehicle present at the (ij) location and this is denoted by 
cesses pixels If in accordance with the recursive for- 
mula defined by equations 1-3 to produce time aver- p tf =i 
aged arrays If, Pixels If are representative of the aver- 
age background intensity of window 43 over the N Logic 58 accumulates Pij values over a window of 
frames. * 15 length six. Using majority rule, if 

Time averaged pixels If are then subtracted from the 

current array pixels If as indicated at summation step 6 
52 to generate an array of background adjusted pixels 

If. This operation can be mathematically performed by . *u t^tr/v m - j * - - 

microprocessor 18 in accordance with equation 4. Uti- 20 over ^ K {K =} 0) w * dow ' a decislon 15 

lizing the background adjusted pixels V allows com- ™^ a ^ e ^ lcle . ls P*f ent v . . # . 

pensation for any natural variations in road surface such . P ^ e 18 determined by vehicle detection at the first 

as those resulting from transitions between bituminous pi^ ot presence aetectton. 

and concrete, railroad crossings, or markings on road T3 £** procedures are Jlustrated with reference to 

surfaces 25 which shows a vehicle 28 present within a one 

Having computed the background adjusted pixels V, J* J hori f ™ md ? w 70 ' Pbtels ^*»> wU1 ^ 

microprocessor 18 generates a spatially averaged array been * 1 by microprocessor 18 per Equation 10, 

Af according to Equations 5 or 6. The size of the aver- smce vehicle 28 was present at the portion of the image 

aging window is chosen to be representative of the size ° overed bv e P^els. Remaining pixels P, and 

of a vehicle 28, and will therefore vary depending upon 30 p ' l2SyS7 wril be set to "0 since they do not represent 

the position and orientation of camera 12 with respect P^ ons °f ""f containing a vehicle. Detection 

to roadway 26 (FIG 1) window 72 is a one by six window in this example. The 

Microprocessor 18 can compute spatially averaged sum of ^ e P kel vaIues encompassed by detection win- 
pixels Af for a 1 by J horizontal window such as 41 dow 72 ( LC - p <'^ySio) * compared to a constant X=4 
using a 1 by L averaging window in accordance with 35 83 bribed by equation 1 1. In this case the sum will be 
equation 5. In a similar manner, equation 6 can be used e(mal *° six so microprocessor 18 will generate a pres- 
to compute spatially averaged pixels Af for a I by 1 ence si S^iL If, for example, window 72 were encom- 
vertical window such as 43 using an M by 1 averaging passmg pixels P* i3£/£i8, the sum would be equal to 
window. Using equation 7 microprocessor 18 can gen- zer0 and microprocessor would generate a signal repre- 
erate spatially averaged pixels Af for a two-dimen- 40 sentative of vehicle absence. 

sional window such as 40 using an M by L averaging Microprocessor 18 can also implement other statisti- 

window. ca * decision criteria such as Bayes for vehicle presence 

FIG. 5 illustrates an example in which spatially aver- decision. Data representative of vehicle passage (e.g., of 

aged pixels Af are generated for a one by thirty hori- a signal switching logic state upon entry into the win- 

zontal window 44 using a one by six (L=six) averaging 45 dow °f interest) can be determined in a similar manner, 

window 46. Thus, Equation 5 becomes Equation 8 for All of the above-described steps are successively re- 

L=6. In so doing, microprocessor 18 will average se- peated for each new frame. 

quential groups of six background adjusted intensity A temporal data processing method which is imple- 

values If throughout the window 44. A first group of mented by microprocessor 18 to determine presence, 

background adjusted pixels, If* is first averaged. 50 passage and other vehicle characteristics such as veloc- 

Next, a second group of background adjusted pixels ity is illustrated generally in FIG. 6. The temporal ap- 

(2SyS7) is averaged in a similar manner. This process is proach estimates the background intensity of the road 

repeated by microprocessor 18 until background ad- surface in the absence of vehicles. This is compared to 

justed pixels liQssjSto) are averaged. The result is a the instantaneous (current frame) intensity and if the 

spatially averaged array Af. 55 latter is greater statistically then a vehicle presence 

As indicated by step 56, microprocessor 18 next com- decision is made, 
putes spatial variance Vf as a function of the back- For temporal processing microprocessor 18 first time 
ground adjusted pixels If and spatially averaged pixels averages die intensity values to produce a time aver- 
Af. This is done for all values If and A^ within the aged array of pixels tf as indicated at step 60. Time 
selected window such as 43 of the nth frame. Variance 60 averaged pixels If are computed similarly to the spatial 
values Vf provide a measure of how much the back- processing in accordance with Equations 1-3. Micro- 
ground adjusted values If vary from the spatially aver- processor 18 then generates a background adjusted 
aged values A^ within the variance window. The van- array of pixels If for the nth frame by subtracting the 
ance window, like the spatial average window, is sized time average If from the instantaneous pixels If per 
so as to represent a vehicle such as 28. Microprocessor 65 step 62 and Equation 4. 

18 can, for example, compute spatial variance values Utilizing the background adjusted intensity pixels, 

Vf over a one by L variance window using the formula microprocessor 18 next generates time variance values 

of equation 9. Qf for the nth frame over R preceding frames as indi- 
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cated by step 64. Time variance values Qf are gener- 
ated as a function of background adjusted pixels if of 
the previous R frames, and a mean or average intensity 
My at the corresponding pixel over N previous frames. 
Microprocessor 18 computes the time variance and 5 
mean values in accordance with Equations 12 and 13. In 
one embodiment, R and N are equal to twenty frames. 

Microcomputer 18 also computes, as part of time 
variance step 64, background variance AQif in the 
absence of vehicles, in a manner similar to that de- 10 
scribed with reference to spatial variance processing 
step 56 illustrated in FIG. 4. The background variance 
aQi/ 1 is computed as a function of a running average 
(Equations 12, 13). If the logic 68 decides that there is 
no vehicle present the variance is updated according to 15 
Equations 12, 13. If there is a vehicle present, according 
to logic 68, then a^ij—aQ^^ij- Tne comparator oper- 
ates as follows. The background adjusted instantaneous 
intensity If is compared to a function of the back- 
ground variance per Equation 14. The function fUQf) 20 
can, for example, be an absolute value or square root of 
background variance values AQif - Constant k will typi- 
cally be between one and four. If the instantaneous 
background adjusted intensity is greater than the func- 
tional relationship of the background variance, a deci- 25 
sion is made by the comparator that a vehicle is present 
in pixel ij. This is denoted by P,y=l, otherwise P t y=0 
(no vehicle). 

P,ypixels with values zero or one are inputs to logic 68 
where they are processed to determine presence and 30 
passage of vehicles. The logical processing at step 68 is 
performed similarly to that described with reference to 
step 58 of the spatial processing method illustrated in 
FIG. 4, and described by equation 11. All of the above- 
described steps are successively repeated for each new 35 
frame or array of pixels ly. 

Although the spatial data processing method de- 
scribed with reference to FIG. 4 and the temporal data 
processing method described with reference to FIG. 6 
provide accurate data relative to vehicle detection, the 40 
performance of system 10 can be improved through 
simultaneous use of these methods. As illustrated in 
FIG. 9, pixel intensity values If for selected windows 
of an nth frame can be simultaneously processed by 
microcomputer 18 in accordance with both the spatial 45 
and temporal processing methods (steps 76 and 78, re- 
spectively). The results from these two processing 
methods (e.g., data characteristic of presence, passage, 
or other characteristics) are then logically processed or 
combined as indicated at step 88 to produce signals or 50 
data characteristic of presence, passage or other charac- 
teristics. In one embodiment, microprocessor 18 imple- 
ments a logical "AND" operation on the outputs of 
spatial and temporal processing steps 76 and 78, respec- 
tively, and generates presence or passage data only if 55 
presence or passage data was generated by both the 
spatial processing method and temporal processing 
method. 

Presence and/or passage data generated by micro- 
processor 18 through implementation of either the spa- 60 
tial processing technique shown in FIG. 4 or the tem- 
poral processing technique shown in FIG. 6 can be 
further processed by microprocessor 18 to produce 
vehicle velocity data. This processing method is de- 
scribed with reference to FIG. 10. The velocity data is 65 
computed by monitoring the logic state assigned to two 
gates such as P,- 12 and P,- 16 over several (N) frames. The 
spatial distance between pixels P/ 12 and P/ 15 corre- 



sponds to an actual distance D in the field of traffic 
based on the geometry and sensor parameter. Micro- 
processor 18 will monitor the number of elapsed frames 
N between the frame at which the logic state of pixel P,- 
12 switches from a logic "0" to a logic "1", and the 
frame at which the logic state represented by pixel P/ 16 
switches from logic "0" to a logic "1". The number of 
frames N" separating these two events corresponds to 
the time At. Microprocessor 18 can thereby compute 
velocity using Equation 15. The accuracy of this deter- 
mination can be improved through computations in- 
volving several pairs. 

Although the present invention has been described 
with reference to preferred embodiments, workers 
skilled in the art will recognize that changes may be 
made in form and detail without departing from the 
spirit and scope of the invention. 

What is claimed is: 

1. A vehicle detection system including: 

sensor means for sensing traffic in a field of view and 
for providing successive arrays of pixels character- 
istic of the field of view; 

a formatter coupled to the sensor means and includ- 
ing an input terminal for receiving subarray selec- 
tion information representative of changeable se- 
lected portions of the field of view and means for 
selecting subarrays of pixels characteristic of the 
selected portions of the field of view from the ar- 
rays provided by the sensor means; as a function of 
the subarray selection information and 

processor means for processing the selected subar- 
rays of pixels and for providing data representing 
presence and/or passage of vehicles within the 
selected portions of the field view. 

2. The system of claim 1 wherein the sensor means 
including: 

a camera for providing video signals representative of 

the field of view; and 
digitizer means for digitizing the video signals to 

produce the arrays of pixels. 

3. The system of claim 1 and further including a ter- 
minal coupled to the formatter and responsive to opera- 
tor actuation. 

4. The system of claim 1 wherein the processor means 
include* means for spatially processing the subarrays of 
pixels. 

5. The system of claim 1 wherein the processor means 
includes means for temporally processing the subarrays 
of pixels. 

6. The system of claim 1 and further including moni- 
tor means coupled to the sensor means for providing a 
visual display of the selected portions of the field of 
view. 

7. The system of claim 1 and further including traffic 
control/surveillance/counting-classifying means cou- 
pled to the processor means for controlling- 
/monitoring/classifying-counting traffic as a function 
of the data representing the presence and/or passage of 
vehicles. 

8. The system of claim 1 and further including mem- 
ory means for storing the data. 

9. The system of claim 1 wherein the formatter in- 
cludes means for receiving information representative 
of selected two-dimensional portions of the field of 
view. 

10. A system of the type including imaging means for 
providing successive pixel arrays characteristic of a 
field of view including traffic, over time, and processor 
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means for processing the pixels to produce data repre- 
sentative of presence and/or passage of vehicles within 
the field of view; which system includes a formatter 
coupled between the imaging means and the processor 
means, and including an input terminal for receiving 5 
subarray. selection information data representative of 
changeable selected portions of the field of view and 
means for selecting subarrays of pixels characteristic of 
the selected portions of the field of view as a function of 
the subarray selection information for processing by the 10 
processor means. 

11. The system of claim 10 and further including 
terminal means coupled to the formatter for permitting 
an operator to control the formatter and select pixels 
characteristic of desired selected portions of the field of 15 
view. 

12. The system of claim 11 and further including 
monitor means coupled to the imaging means for pro- 
viding a visual image of the field of view t wherein the 
operator uses the terminal means in conjunction with 20 
the monitor means to select pixels of interest within the 
field of view. 

13. A method for operating programmable comput- 
ing means to spatially process arrays of pixels represen- 
tative of a field of view of traffic over time so as to 25 
generate data characteristic of presence of vehicles 
within the field of view, including: 

receiving successive sensed arrays of pixels represen- 
tative of a field of view of traffic over time; 

time averaging corresponding pixels of successive 
sensed arrays over time to provide a time averaged 
array; 

summing corresponding pixels of the time averaged 
array with pixels of a sensed array to generate a 
background adjusted array; 

spatially averaging window groups of pixels of the 
background adjusted array to generate a spatially 
averaged array; 

generating a spatial variance array of pixels as a func- 
tion of corresponding pixels from the background 40 
adjusted array and pixels from the spatially aver- 
aged array; and 

generating data representative of vehicle presence as 
a function of pixels of the spatial variance array. 

14. The method of claim 13 wherein spatially averag- 
ing window groups of pixels of the background ad- 
justed array includes spatially averaging window 
groups of M by L pixels, where L is a predetennined 
number of horizontally adjacent pixels and M is a prede- 
termined number of vertically adjacent pixels. 

15. The method of claim 14 wherein spatially averag- 
ing window groups of pixels of the background ad- 
justed array includes spatially averaging window 
groups of one by L pixels. 

16. The method of claim 14 wherein spatially averag- 
ing window groups of pixels of the background ad- 
justed array includes spatially averaging window 
groups of M by one pixels. 

17. The method of claim 13 wherein generating a 
spatial variance array of pixels includes generating a 60 
spatial variance array , of pixels as a function of variance 
window groups of corresponding pixels from the back- 
ground adjusted array and the spatially averaged array. 

18. The method of claim 13 wherein generating data 

as a function of pixels of the spatial variance array in- 65 
eludes generating an absence variance array of pixels 
which is representative of the spatial variance of pixels 
in the absence of vehicles as a function of the data repre- 
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sentative of vehicle presence and pixels of the spatial 
variance array, and generating data representative of 
vehicle presence as a function of pixels of the absence 
variance of array. 

19. The method of claim 18 wherein generating data 
representative of vehicle presence as a function of pixels 
of the absence variance array includes: 

generating an intermediate value as a function of 
pixels of the absence variance array; 

comparing pixels of the spatial variance array to the 
intermediate value generated as a function of corre- 
sponding pixels of the absence variance array; 

denoting pixels as representing a portion of the field 
of view at which a vehicle either potentially is or 
potentially is not present as a function of the com- 
parison; and 

generating data representative of vehicle presence 
when at least a predetennined number of pixels 
within a window group of adjacent pixels are de- 
noted as representing a portion of the field of view 
at which a vehicle potentially is present. 

20. The method of claim 18 wherein generating data 
representative of vehicle presence and/or passage as a 
function of the absence variance of pixels includes: 

generating an intermediate value as a function of the 
absence variance of pixels; 

comparing pixels of the background adjusted array to 
the intermediate value generated as a function of 
corresponding pixels of the absence variance array; 

denoting pixels as representing a portion of the field 
of view at which a vehicle either potentially is or 
potentially is not present as a function of the com- 
parison; and 

generating data representative of vehicle presence 
when at least a predetermined number of pixels 
within a window group of adjacent pixels are de- 
noted as representing a portion of the field of view 
at which a vehicle potentially is present. 

21. The method of claim 13 and further including: 
repeating the steps of time averaging corresponding 

pixels, summing corresponding pixels, spatially 
averaging window groups of pixels, generating a 
spatial variance array, and generating data repre- 
sentative of vehicle presence, so as to generate data 
representative of vehicle presence over time; and 
generating data representative of vehicle passage as a 
function of the data representative of vehicle pres- 
ence over time. 

22. A method for operating programmable comput- 
ing means to temporally process arrays of pixels repre- 
sentative of a field of view of traffic over time so as to 
produce data characteristic of vehicle presence, includ- 
ing: 

receiving successive sensed arrays of pixels represen- 
tative of a field of view of traffic over time; 

time averaging corresponding pixels of successive 
sensed arrays to produce a time averaged array; 

summing corresponding pixels of the time averaged 
array and pixels of a sensed array to produce a 
background adjusted array; 

generating a time variance array of time variance 
pixels as a function of corresponding pixels from a 
predetennined number of successive background 
adjusted arrays; and 

generating data representative of vehicle presence as 
a function of corresponding time variance pixels 
from the time variance array and background ad- 
justed pixels from the background adjusted array. 
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23. The method of claim 22 wherein generating a time 
variance array of time variance pixels includes generat- 
ing a time variance array of time variance pixels as a 
function of corresponding pixels from a predetermined 
number of successive background adjusted arrays, and 
an average of corresponding pixels from a predeter- 
mined number of successive background adjusted ar- 
rays. 

24. The method of claim 22 wherein generating data 
representative of vehicle presence includes: 

generating an absence variance array of absence vari- 
ance pixels representative of the spatial variance 
pixels in the absence of vehicles, as a function of the 
data representative of vehicle presence and corre- 15 
sponding spatial variance pixels; and 

generating data representative of vehicle presence as 
a function of corresponding pixels from the ab- 
sence variance array and pixels from the back- 
ground adjusted array. 20 

25. The method of claim 24 wherein generating data 
representative of vehicle presence as a function of cor- 
responding pixels from the absence variance array and 
background adjusted array includes: 

generating intermediate values as a function of pixels 25 

from the absence variance array; 
comparing pixels from the background adjusted array 

to the intermediate values generated as a function 

of corresponding pixels from the absence variance 

array; 

denoting pixels as representing a portion of the field 
of view at which a vehicle either potentially is or 
potentially is not present as a function of the com- 
parison; and 

generating data representative of vehicle presence 
when at least a predetermined number of pixels 
within a window group of adjacent pixels are de- 
noted as representing a portion of the field of view 
at which a vehicle potentially is present. 

26. The method of claim 22 and further including: 
repeating for a plurality of sensed arrays the steps of 

time averaging corresponding pixels, summing 
corresponding pixels, generating a time variance 
array, and generating data representative of vehicle 45 
presence, so as to provide data representative of 
vehicle presence over time; and 
generating data representative of vehicle passage as a 
function of the data representative of vehicle pres- 
ence over time, 

27. A method for operating programmable comput- 
ing means to process successive sensed arrays of pixels 
representative of a field of view of traffic over time to 
generate data representative of presence of vehicles 
within the field of view, including: 

independently spatially processing the arrays of pix- 
els and generating spatially processed presence 
data representative of the presence of vehicles 
within the field of view; 

temporally processing the arrays of pixels indepen 
dent from the spatial processing step and generat- 
ing temporally processed presence data representa- 



tive of the presence of vehicles within the field of 
view; and 

generating output data representative of presence of 
vehicles within the field of view as a function of the 
spatially processed presence data and the tempo- 
rally processed presence data. 

28. The method of claim 27 wherein generating out- 
put data representative of presence of vehicles includes 
generating data representative of vehicle presence as a 
logical AND function of the spatially processed pres- 
ence data and the temporally processed presence data. 

29. The method of claim 27 and further including: 
repeating for successive sensed arrays of pixels the 

step of spatially processing the arrays of pixels so as 
to generate data representative of the presence of 
vehicles within the field of view over time; 
repeating for successive sensed arrays of pixels the 
step of temporally processing the arrays of pixels so 
as to generate temporally processed presence data 
representative of the presence of vehicles within 
the field of view over time; and 
generating data representative of passage of vehicles 
within the field of view as a function of the spa- 
tially processed presence data and the temporally 
processed presence data. 

30. A vehicle detection system, including: 
means for sensing traffic in a field of view and for 

providing successive arrays of pixels representative 
of the field of view; 
means for controlling the selection of subarrays of 
pixels characteristic of changeable selected por- 
tions of the field of view from the arrays provided 
by the sensor means as a function of traffic within 
the field of view; and 
means for processing the selected subarrays of pixels 
and for providing data representative of presence 
and/or passage of vehicles within the selected por- 
tions of the field of view. 

31. The system of claim 30 wherein the means for 
controllably selecting includes: 

a monitor coupled to the means for sensing for pro- 
viding a visual display of the field of view; 
a terminal; and 

an operator observing the monitor and actuating the 
terminal to select desired portions of the field of 
view as a function of traffic within the field of 
view. 

32. A method for determining information represen- 
tative of the presence and/or passage of vehicles within 

50 a field of view, including: 

sensing a field of view of traffic and generating arrays 

of pixels characteristic of the field of view; 
controlling the selection of subarrays of pixels char- 
acteristic of changeable selected portions of the 
field of view from the generated arrays; and 
processing the selected subarrays of pixels and gener- 
ating data representative of the presence and/or 
passage of vehicles within the selected portions of 
the field of view. 

33. The method of claim 32 wherein controllably 
selecting subarrays includes selecting subarrays of pix- 
els as a function of traffic within the field of view. 

***** 
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